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ABSTBACT . 

The issue of problea awareness and problea definition 
is discussed in this occasional paper. It is proposed that a problea 
can be defined as one of four instances of indeterainancy: anoaaly«r 
unverified fact, uncharted area, or conflicting evidence; further, 
for each of these categories, three levels of piobleas are seen to 
existr <1) what variables are involved; (2) what is their nature; and 
(3) what are their cause/effect re]|.ationships. Three techniques *re 
explained for delineating probleas: the integrative theonoay, facet 
analysis and design, and coaponential analysis. It is suggested that 
these delineation' techniques have tHb applications in the training of 
researchers: (1) as content, which aigbt be taught to the 
researcher-to-be, and (2) as tools to exaaine the area of research 
instruction. (BJB) 
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THE PROBLEM AND PROBLEM 
DELINEATION TECHNIQUES 

by 

William J. Gephart 
Director of Research Services 
Phi Delta Kappa 

In a very real sense the "problem" is the major problem in 
research. In just as real a sense the term is our problem as we 
focus on the means of improving instruction about the research 
process. This paper will take up first the definition of the terms, 
second a description of several techniques for the delineation of 
problems, and finally a discussion of the application of these 
techniques to the ^'problem" of the training of educatio^nal 
researchers. 



WHAT DOES "PROBLEM" MEAN? 

Literature on the research process is in agreement that the 
work of the educational researcher should be based on a carefully 
analyzed problem. Travers states, "The fact is that the major 
effort in the undertaking of research should be devoted to the 
planning stage, which may include not only a careful formulation 
of the problem.. ..but also some preliminary data^ollecting 
activities." (Travers, 1964). Similar statements can be found in 
almost every text on the research process. 

When it comes to helping the student understand what is 
meant by that term, "problem," this body of literature is not 
very helpful. Instructional approaches include: (1) the 
delineation of areas in which problems exist; (2) the listing of 
titles of completed research as examples of problems; and (3) a 
few attempts at defining the term. 
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The first of these approaches is exemplified in Travers' book. 
He presents four broad areas. Such an approach does not assist 
either in the definition of the term, "problem," or in the 
identification of specific problems. Rather, it makes clear the 
locus, the place within which problems exist. 

The second approach is exemplified by several authors. They 
\ string out lengthy lists of titles and assume that by careful 

examination of those titles the student will understand the 
meanmg of the term, "problem," The difficulty in this approach 
results from two things. First, titles are terribly misleading. It is 
not at all uncommon for a title and the content of a report to be 
distinctly different Second, the list of titles contains individual 
Items that are so diverse that even the very perceptive student is 
unable to extract their commonalit; which makes them accept- 
able as problems. 

The third attempt has so much impreciseness of language as to 
be almost impossible. For example. Van Dalen says, "John 
Dewey answered the question (what is a problem) by suggesting 
that a problem arises out of a felt-difficulty. (Van Dalen, 1962) 
Such an instance does not always identify what is commonly 
referred to when we speak of a research problem. In many 
instances the felt-difficulty is a sympton of a problem, while in 
others the felt-difficulty exemplifies an area of knowledge not yet 
mastered by the individual who possesses the feeling. The texts 
that use this approach very quickly disarm the studeiit by 
cautioning him that any old "felt-difficulty" will not suffice. 
Certainly it cannot be a felt-difficulty that has been investigated 
by someone else and just as certainly it must be a significant 
"felt difficulty.'* The failure for these authors to reach clarity on 
the distinction between significance and insignificance hurts 
students' understanding of the term. 

One text (which will remain anonymous since its author is 
revising it) devotes ten pages to explicating the topic, the research 
problem. The first half of this spread discusses the sorry plight we 
are in. Problems abound. We have but to open our eyes to 
identify them. But the graduate student seems incapable of 
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problem awareness hiaboiale discussion i»l the lommonncNS uf 
problem myopia does not help in overcoming the disease » In lad 
It may provide a security ot ^numbers thai is, to my way ol 
thmking, harmful to progress. The student can reason I do not 
have the skill lo identify a problem, the vast majority are like me; 
all of us cannot be flunked. Therefore, why struggle to learn what 
is meant by the term ' 

This same text proceeds to indicate that the student is and 
shouid be on his own in this area. The research effort is a test of 
his mettle and the wiser heads ought not to meddle! I could not 
disagree with an idea more strongly than I do with that. The 
evidence (tne number of poorly delineated problems in graduate 
program research requirements) is overwhelming proof that we do 
not fail people on the basis of poor performance. J^urther, my 
value system holds that a student has the right to expect help in 
learning about an area. I believe it unethical to say in effect, 
*'You are on your own." He is in a learning situation And he has 
bought (or at least paid for) help. Our refusal to piovide the 
needed help is a cover we use to avoid examination of our own 
inadequacy Professors in general do not know to identify and 
define research problems. Again, the evidence is strong. (Smith, 
l%4) Over half of the research proposals Smith studied were 
labeled inadequate due to the nature of the p-oblem statement. 

In concluding this intemperate notation of our problems in 
teaching the concept, "problem,'^ I seek your reactioMcTtluee 
assertions Professors of educational research must help students 
understand what is meant by the term "problem" and how to 
identify and delineate them Definitional studies must be initiated 
to Jarify the meaning of the term, "problem " Once the term is 
defined, empirical tests of approaches for teaching it must be 
conducted 

Three instances in the literature seem helpful in movement 
toward a definition of "problem Two of those instances present 
a common list. 



I He (the researcher) lacks the means to get the end desired. 
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2. He has difflculty in identifying the character of an bbject. 

3. He cannot explain an unexpected event. 

The third statement is somewhat similar. It was made by Clark, 
Cuba and Smith (Clark, Cuba, Smith, 1962) in an outline for a 
text which unfortunately has never been completed. They suggest 
the existence of four types of problems: an anomaly, an 
uncharted area, a situation involving conflicting evidence, or an 
instance of unverified fact. An anomaly can be exemplified by 
the following: Imagine yourself walking along the Artie Circle. As 
you reach the crest of a snow bank you see a palm tree growing 
out of the ice. The facts we know at this point fail to explain that 
observation. An anomaly in the Cuba, Clark, Smith list equates to 
the third item m the list above, inability to explain an unexpected 
event. 

The uncharted area of category of prpblem equates to item 
two m the list above, difficulty in identifying the character of an 
object. In both instances there seem to be avenues which have not 
been explored, 

Category three, the conflicting evidence problem, is not found 
in the other list There are many such instances in the field of 
education. Reading perhaps provides a ready focus. For years 
some reports of research have indicated that Method A is more 
edcctive m teaching reading than Method B, Simultaneously, 
other reports state the opposite. Because of the conflict between 
{he conclusions, a problem still exists. Parenthetically, it seems 
tiiut m such mstances two possibilities exist: Either the research 
methodology IS inadequate or variables other than those investi- 
gated seem to exert greater influence on the criterion. 

I he tlnal category, unverified fact, iilso Is rite in education. 
ILniduiiting provides a case in point Schools, for the most part, 
start children writing with manuscript printing At approximately 
tlie (Inid grade a conversion is made to cursive writing John 
( jri»)ll his indicated tliat no empirical .evidence can be found 
whuli wmild suh^tanliJle either that that sequence is appropriate 
tM ih.K tip; miiing vMtliin the sequence iwahd (Carroll, 1^61). 



The three items in the hsl above and the lour ilems in the 
Clark. Cuba, Smith presentation are all instances of indetermi- 
nacy. That IS, sufficient knowledge does not exist to answer 
questions alout them. On this basis, it would be appropriate to 
define problem as an instance of indeterminacy and in so doing 
one might feel that he has completed the difficult task of telling 
his students what is meant by **problem." 

A SUGGESTED RESOLUriON 

Describing a problem as an instance of indeterminacy is 
indeterminate. In the experience of the author there seem to be 
th/ee categories of indeterminacy the knowledge of which assi^ s 
students in understanding what is meant by a problem. The first 
category is one in which the indeterminacy centers around the 
items, things, variables, that make up the complex with which 
they are dealing. This category of problem might be labeled as 
what-variables-exist-problems. Probably the topic most exten- 
sively researched in this category is intelligence. Of what is 
intelligence comprised? Many factor analytic hours have been^ 
spent in search of that answer. The historical methodology seems 
also applicable. Historians frequently seek infom.ation as to what 
is involved in an event. 

The second category of problems proposed here is included in 
the question, what is the nature of a specified variable? It is not 
enough to state that intelligence involves a verbal factor, we must 
proceed to the identification of the nature of that factor. This 
includes its definition, and the examination of the range in which 
that verbal factor is displayed by individuals. Work of this sort 
defines what is meant by the What-is-the-naturc-of-the-variable- 
problems. 

The final category is one which seeks the answer to the 
question of cause and effect. If a change is induced in variable A, 
what will be its impact on variable B? 

These three categories of problems have a hierarchial arrange- 
ment. If our body of knowledge is unable to produce answers to 



II 



6 

the what variables-exist question, we have identitied a problem 
and the tocu<; for needed research. If that question can be 
answered positively but the body of knowledge fails to provide 
the answer to the What-is-tne-nature-of-the-variable question, 
again the problem has been identified and focus of needed 
research is pinpointed. Finally, given the answer to tne two 
previous questions, yet failure in the literature to answer the 
cause-and-effect questions, the problem is i^lentified and the 
nature of research necessary for its resolution is suggested. It 
must be emphasized that although this hierarchial arrangement 
appears to exist, at any point in time, findings and insights may 
cause us to drop back on the hierarchy. That is, in an effort to 
resolve a cause and effect question, a researcher may uncover the 
need for knowledge about either the existence or nature of an 
additional variable / 

It IS proposed that a problem can be defined as one of four 
instances of indeterminacy, anomaly, unverified facts, uncharted 
areas, ot conflicting evidence. Further, it appears that in each 
category three levels of problem may be identified 

I What variables are involved"^ 

2. What IS the nature of these variables? 

3 What IS their cause and effect relationship'^ 

Using these two means of classification, a grid can be structured 
as displayed in Figure I . It is believed that a student can be aided 
in the identification and delineation of a problem through the use 
of this grid To do so he would first examine the area in which he 
is interested to determine whether an anomaly , unverified fact, 
uncharted area, or conflicting evidence exists. Having so 
examined the area and settled on one of the types of indetermi- 
nacy, he should move then to the answer of the questions which 
label the columns in the grid. At the point where he is unable to 
move further, he has identified a problem and delineated its 
character 
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* What IS the Wlrin> inc 

Type of What variables nature of cj|use ^Xteftect 

Indeterminacy are involved? these variables? /relationship'^ 

Anomaly 



Unverified Fact 



Uncharted Area 



Confiicting 
Evidence 



Fig. I. A Classification System for Research Problems 



It is expected that some problems will be classified as more 
than one of the four instances of indeterminacy. In such cases it 
should be suspected that numerous problems exist. The research- 
er is here. advised to examine the statements he makes as the basis 
for labeling his problem as an anomaly, uncharted area, etc. In 
this examination he may be able to discern differences which will 
separate the several problems which have to this point appeared 
as a single problem. 

Although this procedure sounds simple in words, it is not 
simple in process. In the past few years several techniques have 
developed which can be used as tools in the delineation of a 
problem. The remainder of this report is spent in describing these 
toob and discussing their application. 
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PROBLEM DELINEATION TECHNIQUE 



As aids in the corpplex process of dehjnedting a problem, three 
techniques have evolved. The Integrative Theonomy d-veloped 
Ray Dethy and William Gephart, Facet , Design and Analysis 
developed by Louis Cuttn-in a.id described by Philip Runkel, and 
Componential Analysis .ve loped in the field of anthropology 
and described by Ward Goodenough The three techniques have a 
considerable amount of overlap which should become apparent as 
they are described. This overlap is of interest since three distinct 
fields are represented. The first comes from educationists, the 
second, sociologists, and the third, anthropologists. 

THE INTEGRATIVE THEONOMY* 

This technique evolvec' as an effort was being made to put 
boundaries around a complex area The best short description of 
the Inegrative Theonomy technique would be the phrase, a 
conceptua correlation matrix. A correlation matrix, as you well 
know, is a grid which has un identical number of rows and 
columns and has identical labels for the rows and columns. An 
Integrative Theonomy has those same properties It differs in the 
content within the cells of the matrix In a correlation fable the 
cells consist of numbers ranging from +| to -i. In an Integrative 
Theonomy the cells contain conceptual s atements. 

The application of the technique involves the following 
procedural steps. First, a search is madt of the hterature in an 
area of interest to identify items or vatiables which provide its 




♦This technique underlies the outlinje for Educational Adminstra- 
tion. Selected Readings. Eds. Walter Ha^k, John Ramseyer, 
William Gephart, and James Heck, Boston: Allyn and iBacon, 
1965. The technique was not however described in that publica- 
tion. It has .also been employed as the underlying structure of a 
course in educational administration taught by Ray Dethy at 
Northeastern University, 
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basic structure. Those items make up the h'bcis uh Ihe rows (///</ 
columns of a grid. Development of such a grid has a row ol tclls 
that progress diagonally trom the upper left hand corner to the 
lower right hand corner which have a common label. I hat is, the 
label on the row and on the column are identical. This set of 
diagonal cells serves a specific purpose in the Integrative 
Theonomy, It is the base from which further analysis stems. 
Those cells are the holding point for two things; (I) The 
definition of the term which labels that row and column; and (2) 
A listing'Of the elements subsumed within the definition. 

Once this definition and either the tcxonomic or categorical 
listing is completed the individual is ready to move off those 
diagonal cells. As in a correlation table, those cells below and to 
the left of the diagonal are identical to those above and to the 
right. Completing both sets would be unnecessary. It should also 
be pointed out that the cells off the diagonah are interactions 
between two variables. Every cell from that point on is an 
instance in which to terms with precise definitions can be 
identified as the label The b^sic question asked in each cell is, is 
thercyrf relationship between tljese two terms*' If so, what is it? 

In dealing with a specific content area, many of these cells will 
be filled readily. Some of them, however, will remain blank. 
Blank tells provide possible problem Wentification. Does some- 
thing, some relationship of which we are now. unaware, exist at 
this point'^ 

By examining an area in this manner the individual is lorded to 
focus on the interactions. How do pairs of items relate? From 
studies m the social sciences we are fairly sure that multiple 
interactions play a part in many areas. It is suggested therefore, 
that an examination of the multiple interactions also be under- 
taken aftei the pairs are descried. The inability to describe an 
interaction is an instance of indeterminacy. 

Th's approach enables two kinds of problem delineation 
activities The first results from an instance in .which the literature 
provides information that an interaction exists but its delineation 

o 
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is incomplete The second type of problem occurs in those 
instances in which the literature fails to> provide any information 
at all about a cell. In this case we woulc^ fmd no suggestion in the 
literature that such a relationship exists. However, given the 
structuring in the grid, a^elatiunship is suspected. That.actWity 
would lead the indiVidud to research whic h would confirm or 
disconfirm.the possible mterrelation. 

The author used this technique at one point in ihc examina- 
tion of the secondary school ^urri 'ulum. Figure 2 shows the grid 
that war^tievelpped at the start of that application. The elements 
of the curriculum were identified as Ijibels for the rows and the 
columns The diagonal cells in which common labeling octurs 
were structured with the »definifion of the element the 
currii;ulum focused. The goal in this effort was to deteririne 
ovcijap in the secondary school curriculum; instance^ in which 
the 'same concept is taught but from differing vantage "points. 
IWhere do educational efforts overlap*^ 

The full t^'eatment^ of th? curriculum study will not be 
explicated here as that would require more space than available. 
It^hould suffice to make one or two exa» "ies. A basic concept 
in the area of mathematics is the scalor 'plications of numbers. 
A \ basic concept in science is the establishment of orderly 
descriptions of the physical phenomena surn jnding the indivi- 
dual The second cell in the top row focuses on the interaction in 
the curriculum between science and mathematics. The two 
concepts listed above have a definite interrelationship. In the 
establishmert of orderly descriptions of physical phenomena an 
application exists for the mathematic concept. 

The first cell in the third row would be the interaction 
between science and the social sciences. Again« basic concepts ar** 
available which display this interaction. In social sciences the 
effects of lhe physical surrounding on the social activities would 
be inclu(JlF^! The interaction between these two. provides in- 
stances of complementarity. 

In summary then, the Integrative Theonomy is a conceptual 
correlation technique focusing on the definition and delineation 



Science 



Mathematics Social 



Science 

Mathematics 

Social 

Sciences 

Lanxuafe 

Fine Arts 

Practical 
ArU 
Physical 
Education 



Language 



Pine Arts 



Practical 



Physical 



a. Definition 

b. Concepts 











Arts 


'Education 


Science Ik Math. 
Interactions 


a Definition 
b. Concepts 












Science iPsS 
Interactions 


Math L SS 
Interactions 


a. Definition 

b. Concepts 










Science 4i tang 
Interactions 


Math Mt Lang 
Interactions 


Interactions 


a. Definition 
b/Cwiicwpct 








Science 4i ^A 
Interactions 


Math L FA 
iBteractions 


SS U FA 
Interactions 


Lang It FA 

Intei'mctions 


a. Definition 

b. Concepts 






Science k PA 
Interactions 


Math Jk PA 
Interactions 


SS ft PA 
Interactions 


Lanifr PA 

Interactions . 


FA & PA 
Interactions 


a. Definiyon 

b. Concepts 




Science ir PE 
Interactions 


Math it PE 
Interactions 


SS U PF 

Interactions 1 

L 


Lang & PS 

Interaction . 


FA ft PE 

Interactions 


PA L PE 
Interactions 


a. Definition 

b. Concepts 



FIGURE 2: The Inumtlve Th.onomy AppU.<i ,o the S.co«..ry School Curtculu.n 
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o\ cIcinciHs which cOmpxisO' an area and on the possible 
nitorrolationships among thbse elements This author has found it 
a iiselul te».hmque in conceptuah/ing activities about complex 
areas in the identitkaiun of elements of such arei'S that are 
unknimn 

FACET ANALYSIS AND DESIGN 

I ouiN (lUtinian. a sociologist, has asserted that it is possible In 
advaiKe ot the collection of data to evolve a structural theory for 
observing interrelationships among know^i and unknown aspects 
ot ihe theory The tech.iique he employs is called Facet Analysis 
and Design Riinkel (Runkel. h)65) analyzes Guttman's sugges- 
lums to show ( 1 ) the technique van be employed, and (2) 
that through its employment a more complete understanding ot 
an aiea being sUulreil can evolve. 

I acet AnaKsis .;nd Design invi)ives six steps 

1 I he selection of elements known or suspected to comprise 
ihe problem aiea under scrutiny, 

2 Ihe {>recise detlnition of those elements 

> The exainiriation ot tho'e elements tor common but 

variable aspects (called lacets) 
4 I lie determination ot the levels of those common aspects 

that can be seen m the problem (where possible these leve's 

should be vahd conceptual scales) 
^ Listing the universe of protlles that exist through all 

possible combinations i)f the tacet levels 

Determination ot the relationships among the universe of 

profiles 

This procedure has recently been employed, by the author in the 
examination ol research methodologies (Gephart, Part of 

that presentation will b( used to exemplify Facet Analysis and 
Design 



[Jic literature on research ^methods repeatedly refers to four 
t'oneral subcategories historical, descriptive, ^experimental, and 



quasi-experimental methodologies. In the work cited above an 
effort was made to achieve a precise yet acceptable definition oi 
these four obsen'able categories from the available literature on 
the research process Those definitions are ^ 

1. Historical Meth6d. The use of observations recorded by 
others to interpret what happened to whom. 

2 Descriptive Method. The use of specifically designed 
measuring instruments for'the collection of data to depict 
the manner in which population is distributed on a variable 
or variables. 

3. Experimental Method. The administration of specified 
treatments to a population or a sample of a population and 
the valid and reliable meeiure of the effects of those 
treatments. 

4. Quasi-experimental Method. The administration of treat- 
ments to intact groups and the valid and reliablemeasure of 
effects of those treatments. 

Given the acceptance of those definitions (and I recognize that 
as a major indulgence on your part but one that is necessary for 
the example) three items can^be seen which are common to, yet 
variable in, the four metncds. Those three items or facets, to use 
Guttman's terms, are: unit reprc^f^ .iativeness, treatment adminis- 
tration and measurement fidelity. In the first of these the focus 
IS on the degree to which those units studied represent a specified 
population. The historian is concerned about who what is 
included in the phenomenon he studies. He has to establisH the 
nature of ih6 group on Which h^ has obtained valid records and 
the nature of the population represented by this sample. The 
descriptive researcher, with his objective of depicting, has to 
ascertain the boundaries of the population he studies and the 
degree to which those, on which he has or gets measures 
represents this population. The experimenter must also be 
concerned about the population and sample representativeness, 
because generalizations about cause^and effect require a popula- 
tion relerent The quasi-experinJenter is no less concerned about 
the population. Granted, he works in an arena. in which he is 

denied direct control over representativeness. But he works in 

* 
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llu( lutural setting because ho wants U> know about the effects 
v»t variables in that scitmg Theiefore, liis rnability to repiescnta- 
nvely select a sample and to assign it a treatm^^nt is not 
evidence oi a lack of concern, but rather ^vidi iicc oi his tontern 
tor reality 

Similarly, the four methods involve treatments This is an 
obvious factor in the experiment and the gnuii-experiment 
Xlthough less obvious, it is part of historical and descriptive 
methods The historian is interested in either determining the 
natuie ot a treatment experienced by a group or in the effects of 
tliai treatment The descriptive method focuses on a group for a 
reason Tfiey have had an apparently conimon set of experiences 
which make them an interesting grgup foi description. 

Measurement is also an obvious fac^t of these four methods In 
each case, the mvestigator measures either through tlie use ot 
already existing observations or through the generation of dan 

Given the acceptance of the^e statements, three fa.^^ts aie 
clear representativeness of the unit^ s^uuieJ, content ot the 
treatment experienced, and measurement Udehty, Are there other 
Items common to the tour metliod delinitions^ Yes, each one 
either clearly states or implies \\a it is an effort to Iea|^ 
something Tills is not consideitd as a facet, however, as it is a 
constant in all methods rather tlian something that exists at 
different levels * 

The next a.tuiiy m tiie Facet Design Tech.mque is the 
determination of the levels un the various facets Both Guttman 
and Runkel clearly display the advantage of looking for levels 
tfiat are at least conceptual scales. They imply that the levels 
might be determined by fuither examination ot t!ie detlmtioris 
used to generate the facets. 1 1 the ;e-examinalion ot the four 
definitions above, unit represeiuati^ness has at least two 
characteristics in experimental and descriptive studies the investi 
gator controls tfie representativeness of the units. On the other 
fiand, the quasi-experimentalist and the historian do .lot have 
initial control There seems to be a scale underl>ing these two 
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leveU. If the item is under his control, the investigator can be 
expected to produce greater strength of generalization, it is not 
in his control, conclusions must be tempered with the pj's'^ibility 
that undisclosed uniqueness may cause the unit stur]- J to be 
different from the population to which generahzations a to be 
made. The controlled level is assumed to be more valuable. 

The same pair of levels exists in the measurement fidelity and 
treatment facets, in the former the historian lacks initial controL 
He uses observations recorded by others as his measures The 
three other methodologies are instances in which the investigator 
decides what and how records should be made In the treatnent 
facet the historian and descriptive researcher are in a non coiutol 
situation They deal with units tfiat have experienced a ^reytmcf.t. 
the elements of which they cannot descnbe With surety. The 
experimenter and the quasi-experimenlor on the other hand 
carefuHy structure the experience of the units In both of these 
se's of levels the non-control case coiueptually seems Icsn 
productive of trifth about an unknown than docs the control 
Thus, we have "identified three; facets each of which can be 
analyzed into two lovels, controlled or not controlled by the 
investigator. (In af>otliei eftort the author and Bruce Bartos have 
developed ordinal scales for each of thc^c facets. For the sake ol 
this example, however, only the end^ of the scales^ are discussed 
here.) 

Such an analysis enables u:^to return to the oiiginal set ol 
known element*; and profile them, as sh*>wn in f-igure ^. That 
protHmg is effected by the assignment ot the subscript I in cases 
of non-control and the subscript 2 in casts ol control Thus, the 
historical method would be profiled js niir|ti jnd woiiUI Ic 
described an inquirv luctliod \m \\\viM A\ thicc faicls ,irc 
orignially not ir. the contiul of {\w uivesiigatof Dcscm>li\c 
mt*thodo'or> wuuUl [Mofi^^^d ,\s "»j'2M' ^'''"^ ^aw. o.i.- lu- 
control ovLi mcKurt'muM and rtpios^'fVativencss bjj n >' » .c 
trea4nieni 
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KvnojuIi MoasuicuKMit Rcpicscnt jtivonoNS Treat men t 



Method Fideliiv ut Uiuts Control 



HiNiorical m| r) \\ 

Devnplive nn r2 t| 

OuaM-e\periniental m2 rj 

I xperunenial r2 I2 



Figure } Profiles of Lsiablished ResearLh Methods 



An examination ol these profiles leads to the conclusion that 
there are lou! profile sets One set has all control level facets 
notation (the experimental method) Another has all non-control 
kvel lacet notation UusloriLal method) Between these extremes 
IS a >et that has tv\o facets at the control level and one at the 
noh^ontrul I here is a third pos**ible profile that becomes 
discernible in this set m|r2t2 This would be an inquiry method 
that involves careful control over treatment and ^'epresentative- 
ness faJcts but m a situatuni that does not permit control over 
measurement Such i study might bo labeled an unobtrusive- 
me as^u re men t -e \ pe r i m e n t 

^ \ 

Such^ a jiielhod is beginning to be v;cri in our literature 
I leujcntN si't It cjfi be Neeii in Bak^anJ Guinp's ecological 
psycholog) studies (iuba's ae\pcrinw:irtal methodology papei 
and in 'he tcM cnMlled I nt^hfrusnr Mcustdrcs by Webb, 
t ampbell. S^livvari/, and Se^hrest 

One more cjtegt)r\ ot protlics exists It includes situation/ 
v twv> KkiMn ih.}! jrt' not in the leseaicherN control and one 
Licct thai IV Ifio thicc [M>sNili|e prolllcs w.>uld be m2nM' 
in ) r^l I and m jj ) t2 Tbi^ brings us to a total eight piotiles, jil 
ih.it i')uld poNNihly cxht it a sy^ien, consists o! three lacets each 
o( whwh luis iwu knels Such a system leads to a 2x2x2 matrix, 
and a «otal ol eiglit separate categories Ihe figure below lists the 
Lomplcte set t^t inquiry fuethods. t[^e level ot control in eadi ot 
ilic three lacets, and, where possible, supplies a descriptive name 
tor the stiategy 



ERLC 



17 

Facets on Levels of Control 
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Figure 4 E^^ght General inquiry Methods 



The two unname() methods^ method B and D, do have counter- 
parts in the literature. Method B is one in which measurement 
fidelity is undjr the control of the investigator, but representa- 
tiveness ana treatments are not. This profile seems 1o be 
uidicative of instrument standardization studies. Pilot studies 
conducted prior to an experiment very often fit the character- 
istics of Method D. In such ca^es instructed observations are maVe 
on intact groups after the administration of some treatment. 

Again It IS recognued that lengthy debate can range about the 
eigJit methods identified in Figure 4. Such discussion is wel- 
comed. At this point however, the focus is on the application of 
the Facet Analysis and Design technique. Thus, the debate shall 
be deferred. It is emphasized though, that through the technque a 
categorization system has been created which accounts for the 
Items currently accepted in the literatu»^e and suggests several 
others One of the suggested items accounts for a research 
methodology (case study) that, although recognized, has not been 
acceptable within the categorization u^^e to date. Another of the 
suggested item** can readily be seen as the label for a growing 
methodology This ability, to help one see relationships of items 
which have not in the past been logically structured, is evidence 
of the technique s cHectiveness 
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IS 

Uuct Anjl>MN jiid Design is j technique through which 
dcnmiuns o( known elements which comprise 2 problem area 
u.in be used in the delinejhon of common but vanubfe facets 
Ihcsc IjloIs jnd then underlying scales muke possible the 
piohling ot the number of elements which would comprise the 
piohlcm jreu 



COMPONENTIAL ANALYSIS 

(omponeniul Anjivsis is described by W'jrd Goodenougli as 
•j method of descriptive sematics" which "deals with significa- 
tK)n with definitive attributes and the ways in which they 
combine jnd jre^mutuaiiy ordered." (Goodenough, 1967) It is a 
lou'unque found useful by anthropologists in the delineation of a 
donijin jnd the varution within the domain. It involves two 
steps First. J record is mude of the specific concepts which 
uiformjnis sjy jn expression may denote Second, u set of 
detmitive attributes jbout those concepts is made This set must 
picdkt what informants say may and may not be denoted by the 
expression This latter step i, completed through' two activities 
(I) inspecting tlie concepts for common attributes, and (?) 
contrasting the sei ot concepts with those derived from other 
expressions 

\n example ol ( oinponential Analysis of the term ''aunt" is 
used b> Goodenough to clarify these activities. In step one 
md'vidii.ils are asked to lell what m their experience the term 
••aunt * releis to In such an cUort might produce phrases 
mdicating my nu)tlicr\s sister-in-law, etc. Next he is asked for 
mstances that are not '^aunt An examination of theselists leads 
(ioodenougii to the assertion that aunt yields "any relative to 
hluod or nurnj^c who is simultaneously (i) female, (li) removed 
iToin (he individual by two degrees of genealogical distance, (lii) 
not a iineral removal, (iv) ,n a senior generation, and (y) not 
connected by marital tie in other than the senior generation of 
the relationship " 



Ihvsc tive itcm,s make up the set of definitive attributes 
devciipti\c ol the temi, -aunt They were created by inspecting 
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various phrases people list when asked to telj who (heir aunt is. 
The check of that list of attributes can be made against the list of 
other similar terms, for example, "uncle.** The very first attribute 
in this case differs, consequently femaleness is an attribute 
characteristic of aunts, and not characteristic of uncles. The same 
can be done fo^ each of the items in the set of attributes. Upon 
satisfaction that the set of attributes is complete, that is, all of 
the means of referring to aunt are included by the attributes and 
all of the terms used in describing other expressions are excluded, 
one has identified the components and has completed the first 
aspect of Componential Analysis. 

Two points are emphasized by Goodenough. First, if variation 
is made on one or more of the components a different 
relation.ship is established. Thus, this same set of five variables 
serve in delineating multiple terms such as, aunt, uncle, nephew, 
niece, great aunt, etc. The five attributes so identified seem to be 
the componential base for the construct, "relationship.** To 
complete the Componential Analysis of that universe we must 
move to the variance that can be accepted in each of the 
elements. Foi example, element (i) deals with sex, consisting of 
the two categorifs, male and female. Element (ii) genealogical 
distance would encompass same generation, one generation 
removed, two generations removed, etc. The same type of 
analysis is continued for each of the elements. When this is 
completed the componential base for the domain, "relation- 
ships,*' is in hand. 

The second point that needs to be called to attention is that of 
nesting. In the relationship example it can readily be seen that the 
terms "father** and "mother** nest in the term "parent.'* In a 
different example, "collie*' is nested within the term **dog,** 
which is nested within the term "mammal,** etc. Nesting then is a 
concept appropriate within componential analysis, a point that is 
readily acceptable. A more Important understanding /s that 
nesting denotes differentiation in contrast level The level of 
contrasting in dealing with father and mother includes an item 
not included at the level of contrast in distinguishing between 
parent and non parent That item is sex. 
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In hb article Goodenough applies the technique to the kinship 
tics in another tuhure. In that application eleven elements are 
idcntitlcd as (he coniponential base for the domain. A schematic 
icprcseniation of rhal anal>si'> is presented in Figure 3. It is 
intcresling lo nole that this arrangemenl is an unbalanced system 
I xperuuKcs with the Facet Analysis and Design and Integrative 
Iheononiy techniques lead to questions about the incomplete 
elements in Ihe representation. 



P^IOBLEM DELINEATION IN THE TRAINING 
OF RESEARCHERS 

Ihe diNtLisMon of ihe meaning of the term "problem" and the 
throe icthniques described above seem to have two applications 
in our lot Us on research tiaining First, they could be accepted as 
couie.it wliich might be taught to the researcher-to-be. Second, 
\Ki: might Use them to examine the area, research instructioh, 
Altiiougii the first of these is interesting, the latter seems more 
i:cimjnc lor a group intere*^icd in improving instruction on 
cducjtioiuil lOscardi. In the use oi these approaches it is belie\ed 
that two ends can be served It the problem identification grid 
presented at the outset of this paper is of value it should help us 
pinpoint problems in the training of researchers. And, if the three 
problem delineation techniques are of value, their use ought to 
facilitate movement to careful empirical studies of the research 
instruction process The discussion which follows is not based on 
work m whkh these techniques have been applied to research 
Htsmiction Results of their use I'f other problems, however, 
merit their consideration. 

I( we apply these procedures we would first ask ourselves, 
what IS the nature of the concern ' The answer is immediately in 
mind. We are trying to improve the means by which we help 
pcupic master conicpts about and skills needed in educational 
roscarch. But that is a rather gross area. Its size does not 
aiiiDmaticalfy make it a research problem. Is there some 
inJelermina'cy m what we are trying to do? The literature seems 
!(' }> \hcrc IS We mc unable to educdte a sufficient quantity of 



ERLC 



2^: 



21 



Universe 




A ' Simitanty of Generation (A Same, A^' Different) 
B - ClOMeneaa of relationahip (B i= Cloaeat poaaibie, B2' 
Not cloae) 

C - Number of generattona between (C 1= 1 generation 

apart, €2= 2 generattona apart) 
D - Similarity of aex of aenior party A of living parent of 

junior party ^Dj* Same aex; D2' Different aex) 
E - Relative age of aenior party A of living parent of 

junior party (E Senior party older, E2'' Senior party 

younger) 

F ' Sex of aenior party (Fj' Male, F2' Female) 



FIG. 5 COMPONENTIAL ANALYSIS OF KINSHIP TIES* 

♦W Coodenough, SCIENCE 156. p. 1207, l%7 
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skilled peisonnel and the quality of those educated is below what 
is desired. <. 

What typr of indeterminacy is that? Is it an anomaly, an 
uncharted area*' It is an instance of conflicting evidence or 
unverified fact> Arguments can be presented which would 
indicate that several of these categories are appropriate. It \i an 
anomaly. Highly reputable people have devoted a let of time and 
effort to the training of researchers, yet effective means for that 
task have not been identified. These same skilled people have 
solved other complex problems. 

lie problem can also be described as an uncharted area in that 
a search of the literature fails to produce evidence which would 
enable assertive statements as to its nature. Lists of courses 
offered and hortative jrticles which describe what ought to be 
taught can be identified. Empirical evidence, however^is lacking 

The problcin tan also be described as one of unverified fact. It 
does appear that the profession has accepted four general cgurse 
work areas as the content of research framing These include 
\courses in (I) mtrodu^tion to research, (2) measuremcr^t, (3) 
^atistical analysis, and (4) advanced design. In recent years a 
focus has been made on pra^ticum activities Empirical evidence 
which would Lonfirin the inclusion or exclSsion of these elements 
IS not available 

The inability to definitively Lategori/e the problem leads to 
the suspicion that a number of problems exist Giveri H e ways we 
have looked at the problem, it is an anomaly AND an uncharted 
area AND unverified fact What is it about these my$ of looking 
that lead to multiple categorization'* Is it possible that the 
multiple categorization is a result oi lotusing sitiiultaneously on 
different aspects of the problem ' What is it ab^ut the problem 
that leads us to label it an anDiiiaiy'' An unpjiarted area? An 
instance of unverified fact'> Are ihe things tha^ead to the first 
label different from those leading to the other two? Is there any 
sequentiality in these differenLCs ^ Is it possible that elimination 
ol the things that lead to the label '^unverified fact*' is required 
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before the anomalous aspects of the problem can be resolved*^ Is 
the other order likely? 

One can list quite a number of questions at this point and they 
can be responded to. However, the response ought to be based on 
evidence and logic, not logic alone. The assistance of this 
audience is generating that evidence is desired. 

The list of questions presents a difficulty. Each of them is 
interesting. But are they related'' Are some of them at^i more 
basic level than others. The listing above fails to provide cues in 
this direction. The second aspect of the problem delineation grid 
presented in this paper was a hierarchy of questions. Wha^ 
variables exist'' What is their nature? And, what is their 
cause-and-effect relationship'' It is believed that this hierarchy can 
assist in ordering the questions we can raise about the research ^ 
Uauiing problem. 

What variables led us to classify the problem as an anomaly'' 
What is the nature of these variables? Are there cause and effect 
relationships among them'' The answers to these questions should 
lead us to the pomt of indeterminacy that made that label, an 
anomaly, appropriate. If this same effort is made in respect to the 
other two problem labels we uuglit to be able to pinpoint the 
basic problem and to fix on a priority of research efforts 
neces'sary to resolve the difficulty. 

When the problem (or problems) in research training is 
identified, beneQdal use of the three delineation techniques is 
setn. For example, it might be decided that the basic problem in 
res.earch instruction is inadequate knowledge about the nature of 
the research proces'5 Given suth a (.lecision. Componential 
Analyse,* Integrative Theonomy, or Facet Analysis and Design 
procedures 'could be utilized to dcteimine the nature of the 
elements now known to be involved. The elements not now 
known to logically constitute the remainder of the domain the 
research process, and the interrelationships that might be sus- 
pected. It might be decided that the basic problem is, deficiencies 
In instruction strategies. Agaii^, the three, techniques seem 
applicable. 
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i hesc iwu. problem possibilities are selected as examples for a 
KMsoii. It has been recognizee ;ii several other education areas 
icccnlly that progress requires the development of clarity in 
disc*rimiiution between the subject taught and the methods for 
\\ut instruction Asahel Woodruff (Woodruff. 1968) has hefped 
draw ihiN distinchon. He argues that a behavior, which is an 
objective of an educational system, consists of conditioned and 
c )gniHve aspects anJ involves language and data elements. This 
model can be applied to objectives in research training. There 
appear lo be conditioned aspects of research activity. That is, 
vJien an individual encounters an instance of indeterminarcy, as 
a rcNcarcher he ought to feel the need for empirical evidence for 
lis resolution At the same time, there are cognitive aspects he 
has lo know the how and whys of data generation and analysis 

'Woodruff indicates that behaviors can be placed on a 
continuum of prediLtabiliiy. At one end are those behaviors' 
wIiilIi are extremely Lonsistent and at the other end are those 
behaviors which are extremely consistent and at the other end 
ihose which are quite variable. Examples of these extremes would 
be 

4 

1 If a hand is placed on a hot stove the behavior can be 
predicted with a fair degree of accuracy. The hand will be 
withdiawn 

2 If individuals are placed in portions in which behavio: 
involves the resolution of an educational problem. vari:»tion 
from person to person will be readily observable. 

In Woodrutfs model presented below this combination of 
cognitive and conditioned aspects of a given behavior is displayed. 




PredictabiliO of Bohdvior 



1"^^^ High 

I ifiure b I he C.»gniH\e and ( onditionitjg Aspects of Behaviors 
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The space below the diagonal line includes the conditioned 
response aspects of a given behavior. The space above the 
diagoiAl line includes the conceptual component of that be- 
havior. If a behavior islocated at the extreme left of the model, it 
is interpreted as almost an entirely conditioned response and 
extremely predictable, ihe opposite extreme would be a behavior 
that is almost totally conceptual. Any giv«n behavior held as an 
educational objective exists somewhere within the vertical lines of 
the model as it has both cognitive and conditioned response 
aspects. 

Teachings which has as its objective the achievement of such a 
behavior, has to take into account two iror^tcms. These .ncludc 
first, the language or expressive natu* of the behavior. The 
second element (also described by Woodrufl) Is the data 
necessary for engaging in the behavior. Data in 'lis respect are 
interpreted either as numbers, items, things, or materials neces- 
sary to engage in the activity. The concentration here, for the 
teacher at least, is the means of assisting the student to identify 
the necessary materials or data or the knowledge of the means of 
' creating data necessary for a behavior. Thus, the teaching of a 
behavior recognized as an aspect of the research process involves 
the establishment of conditions whereby: 

1. The cognitive aspects of the behavior as mastered by the 
learner. , ' 

2. The conditioned responses are developed. 

3. The expressive language of the behavior is mastered by the 
student. 

4. The data required for participation in that behavior are 
either available or generatable by the learner. 

Those things done by the teacher to establish these four 
conditions are the items intended by the term "the teaching of 
research.** They ought to be differentiated from their product, 
research behaviors, if we are to resolve our instructional prob- 
lems. 
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SUMMARY 

IhiN pieNCiiijtion lu> j>sericd ilut the term "problem*' is 
poorK Jolincd in the literature on the research process It has 
CvpliMcd iUc poNMhihlv o! delineating a delinition lor that term 
and throe tcchnique> in the hteralure \\hicii provide means for 
dclincarion ot probleni> Finally, it attempted to suggest that 
thoNC means have application to the problem of the teaching of 
revearchers It is recogmzed that this latter area is the weakest 
aspeti ot the presentation as it asserts applicability primarily on 
the basis ol unrelated applications The application of these 
techniques has been stimulating in other areas. Berause of that 
siinujlalion It seems probable that they could be helpful m the 
probTenis laced ii) the training ol researchers The assistance of 
this audience is solicited in making that application and testing 
their utilit\ 
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